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Cognitive flexibility is a critical ability for adapting to an ever-changing environment in 
humans and animals. Deficits in cognitive flexibility are observed in most schizophrenia 
patients. Previous studies reported that the medial prefrontal cortex-to-ventral striatum 
and orbital frontal cortex-to-dorsal striatum circuits play important roles in extra- and intra- 
dimensional strategy switching, respectively. However, the precise function of striatal 
subregions in flexible behaviors is still unclear. A/-methyl-D-aspartate receptors (NMDARs) 
are major glutamate receptors in the striatum that receive glutamatergic projections 
from the frontal cortex. The membrane insertion of Ca^+-permeable a-amino-3-hydroxy- 
5-methyl-4-isoxazole-propionic acid receptors (AMPARs) depends on NMDAR activation 
and is required in learning and memory processes. In the present study, we measured 
set-shifting and reversal learning performance in operant chambers in rats and assessed 
the effects of blocking NMDARs and Ca^+-permeable AMPARs in striatal subregions on 
behavioral flexibility. The blockade of NMDARs in the nucleus accumbens (NAc) core 
by AP5 impaired set-shifting ability by causing a failure to modify prior learning. The 
suppression of NMDAR-mediated transmission in the NAc shell induced a deficit in set- 
shifting by disrupting the learning and maintenance of novel strategies. During reversal 
learning, infusions of AP5 into the NAc shell and core impaired the ability to learn and 
maintain new strategies. However, behavioral flexibility was not significantly affected 
by blocking NMDARs in the dorsal striatum. We also found that the blockade of Ca^+- 
permeable AMPARs by NASPM in any subregion of the striatum did not affect strategy 
switching. These findings suggest that NMDAR-mediated glutamate transmission in the 
NAc contributes more to cognitive execution compared with the dorsal striatum. 
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INTRODUCTION 

Strategy switching as a cognitive ability is critical for adapting 
to and surviving in an ever-changing environment. Impaired 
cognitive flexibility is one of the core symptoms of schizophrenia 
(Orellana and Slachevsky, 2013). Considerable studies in humans 
(Hampshire and Owen, 2006; Chamberlain et al., 2008) and 
animals (Ragozzino et al., 1999; Birrell and Brown, 2000) indicate 
that the medial prefrontal cortex (mPFC) is involved in switching 
attention between stimulus dimensions, whereas the orbitofrontal 
cortex (OFC) mediates reversal learning intradimensionally. The 
striatum is one of the major brain regions to which frontal cortex 
glutamatergic neurons project (Reynolds and Zahm, 2005; Xu and 
Siidhof, 2013), but the role of this region in cognitive flexibility is 
not well-known. 



Abbreviations: DMStr, Dorsomedial striatum; DLStr, Dorsolateral striatum; 
NASPM, 1-naphthylacetylspermine; PE, Perseverative error; RE, Regressive 
error; NE, Non-reinforced error. 



The systemic blockade of the GluN2B subunit of N-methyl- 
D-aspartate receptors (NMDARs) selectively impairs behavioral 
flexibility without influencing initial reward-response association 
learning (Dalton et al, 2011). Subchronic treatment with the 
noncompetitive NMDAR antagonist ketamine reduces persever- 
ative errors during extradimensional set-shifting but impairs 
intradimensional reversal learning (Floresco et al., 2009). Set- 
shifting ability is impaired by subchronic treatment with the 
NMDAR antagonist phencyclidine (Egerton et al, 2008). The 
phenotypes induced by these treatments closely resemble het- 
erogeneous symptoms in schizophrenia patients (Jentsch and 
Roth, 1999), implying that NMDARs in the brain participate 
in the process of replacing old strategies with new ones. How- 
ever, the precise brain region where NMDARs play a role in 
cognitive flexibility requires further elucidation. NMDARs in the 
striatum may make a large contribution to this type of flexible 
behavior. NMDARs are widely expressed on striatal neurons 
that receive glutamate inputs from the frontal cortex. However, 
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only a few studies have suggested that NMDAR activation in 
the dorsomedial striatum (DMStr) and dorsolateral striatum 
(DLStr) differentially contribute to reversal learning (Palencia 
and Ragozzino, 2004, 2005). In addition to NMDARs, a-amino- 
3-hydroxy-5-methylisoxazole-4-propionate receptors (AMPARs) 
are another main type of glutamatergic receptor. AMR\Rs are 
divided into GluA2-lacking and GluA2-containing receptors, 
which have different calcium permeability (Plant et al., 2006; 
Isaac et al., 2007). Although calcium-permeable GluA2-lacking 
AMPARs comprise a small proportion of the normal central ner- 
vous system, their insertion into the synaptic plasma membrane 
occurs during the early phase of long-term potential (LTP), sub- 
sequently triggering GluA2- containing AMPAR insertion into the 
membrane (Jaafari et al., 2012). NMDAR activation modulates 
GluAl subunit phosphorylation and dephosphorylation, which 
are associated with GluA2-lacking AMPAR trafficking and long- 
term plastic changes (Toyoda et al., 2009; Opazo et al., 2010; 
Ai et al, 2011). The infusion of the AMPAR general antago- 
nist LY293558 and NMDA receptor antagonist MK-801 into the 
mPFC significantly increased the number of trials required to 
reach criterion performance in a set-shifting task (Stefani et al., 
2003). In aged rats with impaired set-shifting ability, higher levels 
of NMDAR binding in the DMStr are correlated with poorer 
set-shifting performance, with no changes in AMPAR binding 
level (NicoUe and Baxter, 2003). Thus, an unresolved issue is 
whether GluA2-lacking AMPARs in the striatum participate in 
strategy switching as a molecular event downstream of NMDAR 
activation. 

The present study clarified whether NMDAR and AMPAR 
activation in the striatum is necessary for cognitive flexibility. 
We compared the total numbers of trials and errors to 
reach criterion between control and antagonist-treated groups 
during set-shifting and reversal learning tasks. Rats were 
microinjected with the NMDAR-selective antagonist (2J?)-amino- 
5-phosphonopentanoate (APS) or GluA2-lacking AMPAR antag- 
onist 1-naphthylacetylspermine (NASPM) into subregions of the 
striatum before performing the behavioral tasks. Four subregions 
of the striatum are the nucleus accumbens (NAc) core, NAc 
shell, DMStr, and DLStr. Traditionally, the term "striatum" refers 
to the dorsal striatum. The NAc is referred to as the ventral 
striatum because it is considered to be the predominant part of 
the ventral striatum. The shell and core subregions of the NAc 
have different connectivity, with the shell more closely related to 
the limbic system and the core more closely related to the dorsal 
striatum (Berendse and Groenewegen, 1990; Voorn et al, 2004). 
In the present study, the types of errors were further analyzed 
to reveal possible behavioral components that were affected by 
the treatments, including prior memory and the learning and 
maintenance of new strategies. 

MATERIALS AND METHODS 
SUBJECTS 

Male Sprague-Dawley rats (Vital River Animal Center, Beijing, 
China), weighing 280-300 g upon arrival, were used in the 
study. The rats were individually housed in stainless-steel sliding- 
drawer-type cages (50 cm length x 32 cm width x 22 cm height) 
with a wire mesh floor and pine wood-shavings below the cages. 



The rats were maintained on a 12/12 h light/dark cycle (lights on 
at 7:00 AM), with water and food available ad libitum. All of the 
rats were gently handled daily for 1 week before the behavioral 
experiment began. The experimental procedures were approved 
by the International Review Board of the Institute of Psychology, 
Chinese Academy of Sciences, and were in compliance with the 
National Institutes of Health Guide for Care and Use of Labora- 
tory Animals. 

APPARATUS 

The behavioral experiments were conducted in eight operant 
chambers (29 x 29 x 26 cm; Anilab Software and Instruments 
Co., Ltd., Ningbo, China) enclosed in sound-attenuating boxes. 
Each chamber was fitted with two nosepoke operandi, one of 
which was located on each side of a central liquid receptacle. Two 
yellow light-emitting-diode cue lights (20 mW) were separately 
situated inside the nosepoke holes. A white chamber light was 
located 20 cm above the right nosepoke hole. Solutions were deliv- 
ered through a metal spout that was attached to a 60-ml syringe 
pump with tubing that delivered fluid at a rate of 34.450 ml/min. 
The pumps were calibrated to dispense 0.08 ml (0.139 s) of 
solution into a liquid receptacle for each reinforcement. A timeout 
period of 10 s followed each reinforcement, during which further 
nosepokes produced no effect. 

SURGERY 

The rats were anesthetized with sodium pentobarbital (60 mg/kg, 
i.p.) before cannula implantation surgery. After being placed in a 
stereotaxic frame, a midsagittal incision was made to retract the 
scalp and expose the cranium. Bilateral 23-gauge stainless-steel 
guide cannulas (Plastics One, Roanoke, VA, USA) were implanted 
into the NAc core (flat skull: anterior/posterior [AP], -1-1.6 mm; 
medial/lateral [ML], ±1.5 mm from bregma; dorsal/ventral [DV], 
-7.2 mm from dura), NAc shell (AP, -1-1.7 mm; ML, ±1.0 mm; 
DV, -7.8 mm], DMStr (AR -l-l.O mm; ML, ±1.8 mm; DV, -4.5 
mm), or DLStr (AP, -1-1.2 mm; ML, ±3.5 mm; DV, -4.5 mm). 
The coordinates were based on the Paxinos and Watson (1997) 
rat brain atlas. Four jeweler's screws and dental acrylic were used 
to secure the cannulae to the skull. Thirty-gauge obturators were 
placed on the ends of the guide cannulae until the injections were 
made. Each rat was given at least 7 days to recover from surgery 
before behavioral training. 

BEHAVIORAL FLEXIBILITY TEST 
Habituation 

At the beginning of habituation, the rats were placed in the oper- 
ant chambers. They were allowed to freely explore the chamber 
for 15 min with the nosepoke light off Sucrose reinforcement 
was unavailable during this period. A 60-min session was used 
to train the rats to learn that the sucrose solution was available in 
the central liquid receptacle. The chamber was illuminated by two 
nosepoke lights, and liquid was delivered into the central liquid 
receptacle on a variable interval (VI) 40-s schedule (Chudasama 
and Robbins, 2003). One second before the liquid was dispensed, 
the house light (as the conditioned stimulus) was turned on and 
remained illuminated for 4 s. During habituation, 20% sucrose 
(wt/vol) in tap water was used as the liquid reward. To ensure that 
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the rats drank more sucrose in the operant chambers, water and 
food were removed from their home cages 2 and 18 h, respectively, 
before habituation began. Throughout operant training and test- 
ing, the rats were allowed access to food for 1 h per day after each 
daily session to maintain their body weight above 85% of their 
baseline weight (Dias-Ferreira et al, 2009). 

Side preference was assessed during the habituation period. In 
this session, the rats could nosepoke either the left or right hole, 
which were not associated with sucrose reward. To balance the 
effect of side preference, the number of nosepokes was recorded. 
If the number of left or right nosepokes was two-times higher than 
the number of nosepokes on the other side, then the former was 
designated the preferred side. 

Visual-cue learning 

Twenty-four hours after the habituation session, the rats were 
required to respond at the nosepoke hole with an illuminated 
visual-cue stimulus light. During illumination of the active 
nosepoke hole light, a nosepoke into the correct hole (active 
hole) turned on the house light and switched on the syringe 
pump 1 s later. Nosepokes in the other hole (inactive hole) 
had no scheduled consequences. The acquisition criterion was 
defined as nine consecutive correct responses. A similar criterion 
was used in previous studies (Floresco et al., 2008; Haluk and 
Floresco, 2009; Dalton et al., 2011). The rats were returned 
to their home cages if they did not successfully achieve the 
acquisition criterion after 100 trials. Two hours later, the rats 
were removed to the operant chamber, and a new session began 
until the criterion of nine consecutive correct responses was 
reached. 

Set-shifting 

One day after visual-cue learning, the set-shifting task was con- 
ducted using the same group of rats. The acquisition of this 
discrimination task required the animal to cease the use of the 
previous visual-cue discrimination strategy and instead use a 
direction-discrimination strategy to obtain the sucrose reward. 
A correct response consisted of responding at the nosepoke hole 
that was opposite to the rat's side bias (left or right), regardless of 
the location of the stimulus light that was illuminated previously 
in one of the nosepoke holes. Similar to the initial visual-cue 
discrimination, in every pair of trials, the left or right stimulus 
light was illuminated once, and the order was random within the 
pair of trials. The trials were conducted identically to the initial 
visual-cue discrimination trials. In each trial, the nosepoke hole 
that the animal chose and the location of the stimulus light were 
recorded. The trials continued until either (1) the rat achieved 
criterion performance of nine consecutive correct responses or 
(2) 100 trials were completed. In this experiment, all of the rats 
achieved criterion performance within this allotted number of 
trials. 

Reversal learning 

One day after the set-shifting trials, the rats were required to learn 
a reversal of the response rule. The rats had to nosepoke in the 
hole opposite to the one they learned during the set-shifting task 
on the preceding day. Thus, if a rat was required to nosepoke in the 



left hole during the set-shifting task, then it had to nosepoke in the 
right hole in the reversal learning task, regardless of the position 
of the visual cue. The other aspects of the training were identical 
to the response discrimination training day. One of the visual-cue 
lights was illuminated prior to the start of each trial and served as 
a distracting stimulus. 

Error analysis 

We performed an error analysis of the set-shifting and reversal- 
learning data as reported previously (Ragozzino and Choi, 2004; 
Floresco et al., 2008; Ghods-Sharifi et al., 2008). A perseverative 
error occurred when a rat responded in a nosepoke hole while 
the stimulus light was illuminated during trials in which the rat 
was required to nosepoke in the opposite hole. Eight of every 
16 consecutive trials required the rat to respond in this manner. 
These types of trials were separated into consecutive blocks with 
four trials each. "Perseverative errors" were scored when a rat 
made such errors in three or more trials per block of four trials 
that required a nosepoke in the hole that did not have the stimulus 
light illuminated. When a rat made two or fewer perseverative 
errors in a block for the first time, all subsequent errors of 
this type were no longer counted as perseverative errors because 
at this point the rat was using the original strategy less than 
75% of the time (as was used for the operant chamber-based 
procedures). Instead, these errors were now scored as "regressive 
errors". "Never-reinforced errors" were scored when a rat nose- 
poked in the incorrect hole in trials in which the visual-cue light 
was Qluminated at the same hole that the rat was required to 
nosepoke during the set-shifting task. During the reversal learning 
session, errors were scored as nosepokes in the hole that was 
rewarded during the set-shifting task and were subdivided into 
perseverative and regressive errors using a procedure that was 
similar to the one used to analyze these types of errors during the 
set-shifting task. Perseverative errors were scored when a rat made 
three or more perseverative within a block of four trials, excluding 
the first block. When a rat made fewer than three errors within a 
block of four trials, all subsequent errors were scored as regressive 
errors. 

MICROINFUSION PROCEDURE 

Before testing set-shifting, reversal learning, or initial visual- 
cue learning, the rats received a bilateral intra-brain region 
injection of NASPM (1.25 (xg per hemisphere, 5 |xg/|il), APS 
(0.25 (Xg per hemisphere, 0.5 |ig/ixl), or their corresponding 
vehicle solution (0.9% NaCl solution). Saline or the antagonist 
was infused at a rate of 0.25 |il/100 s (NASPM) or 0.5 (il/lOO s 
(AP5) by a microsyringe pump. The injection needles were left 
in place for an additional 1 min to allow for drug diffusion. 
Following the infusion, the rats were placed in the operant 
chamber. Behavioral testing commenced 5 min (NASPM) or 
15 min (AP5) later. NASPM and AP5 were purchased from 
Sigma. 

HISTOLOGY 

After behavioral testing, the rats were sacrificed in a carbon diox- 
ide chamber. The brains were removed, fixed in a 4% formalin 
solution, frozen, sliced into 50 \im coronal sections, mounted 
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FIGURE 1 I Images showing cannula tracks and needle-tip locations in 
the NAc core (A), NAc shell (B), DMStr (C), and DLStr (D). After the 
behavioral tests, the rats were sacrificed. Brains were removed and fixed in 
a 4% formalin solution. The brain slices were collected in 50 |j.m coronal 
sections prior to being mounted and stained with NissI staining solution. 
Images are shown on the top of each pattern. The distribution of the 
infusion sites was plotted on drawings of coronal sections from the Paxinos 
and Watson (1997) atlas. NAc, nucleus accumbens; DMStr, dorsomedial 
striatum; DLStr, dorsolateral striatum. 



on slides, and stained with Cresyl violet. The needle placements 
were verified with reference to the neuroanatomical Paxinos and 
Watson (1997) rat brain atlas. Figure 1 shows the approximate 
points of the bilateral infusions into the NAc core, NAc shell, 
DMStr, and DLStr. Data from rats with improper cannula place- 
ments were excluded from the analyses (9% of the total number 
of animals). 

DATA ANALYSIS 

The data were analyzed using GraphPad Prism 6.0 software. The 
numbers of trials and errors to reach criterion were separately 
analyzed using two-way analysis of variance (ANOVA) for each 
brain region, with Treatment as the within-subjects factor and 
Training phase as the between-subjects factor. Significant main 
effects in the ANOVA were followed by Bonferroni multiple- 
comparison post hoc tests. Subsequent targeted analyses that com- 
pared the numbers of each type of error were conducted using 
two-way ANOVAs. The effects of APS on simple learning were 
analyzed using two-tailed f-tests per NAc subregion. The criterion 
for statistical significance was set to p < 0.05. 



RESULTS 

EFFECTS OF BLOCKING NMDARs IN NAc SHELL AND CORE ON 
SET-SHIFTING AND REVERSAL LEARNING 

Fifty-three rats were trained to obtain 20% sucrose solution by 
nosepoking the hole associated with the visual cue. Twenty- 
four hours later, 15 rats were infused with AP5 into the NAc 
core before the set-shifting task, and 36 rats were infused with 
the corresponding saline vehicle. Twenty-four hours after the 
set-shifting task, the rats that received saline treatment during 
the set-shifting task were divided into an APS infusion group 
(19 rats) and saline infusion group (17 rats) for the reversal 
learning task. The two-way ANOVA of these data revealed a 
significant effect of Treatment on both the number of trials to 
reach criterion (F(i,83) = 9.441, p < 0.01; Figure 2A) and the 
number of errors before reaching the criterion (-F(i,83) = 14.54, 
p < 0.001; Figure 2B). Multiple-comparison analysis revealed that 
the rats that received APS infusion required significantly more 
trials {p < 0.05) and made more errors {p < 0.01) compared with 
saline infusion during reversal learning. AP5 infusion significantly 
increased the number of errors to reach criterion (p < 0.05) but 
not the number of trials to reach criterion (p > 0.05) during the 
set-shifting task. Subsequent analysis of the types of errors during 
the set-shifting task made by the rats that received AP5 revealed 
a significant effect of Treatment (f(i,i47) = 4.392, p < 0.05; 
Figure 2C). Multiple-comparison analysis indicated that this 
treatment increased the number of perseverative errors {p < 0.05) 
but not regressive errors or never-reinforced errors {p > 0.05). In 
the reversal learning task, the analysis of the types of errors also 
showed a significant effect of Treatment (-F(i,68) = 5.624, p < 0.05; 
Figure 2D). However, this difference resulted from an AP5- 
induced increase in the number of regressive errors {p < 0.05) and 
not perseverative errors (p > 0.05). Two subtypes of regressive 
errors were further analyzed by two-way ANOVA. The results 
showed a significance increase in the number of regressive errors 
toward the visual cue {p < 0.05) and a trend toward an increase 
in the number of regressive errors away from the visual cue. 

The effects of AP5 infusion in the NAc shell on behavioral 
flexibility are shown in Figure 2. A total of 37 rats were assigned 
to either the saline or drug treatment group based on their perfor- 
mance during the visual-cue training. AP5 was infused into the 
NAc shell before the set-shifting task, 24 h after initial cue learn- 
ing. Twenty-four hours later, half of the rats were infused with 
saline vehicle during the set-shifting task and infused with AP5 
before the reversal learning task. The other half were administered 
saline. The analysis of these data revealed a significant effect of 
Treatment on the number of both trials (f (1,55) = 9.426, p < 0.01; 
Figure 2E) and errors (f(i,55) = 9.96, p < 0.01; Figure 2F) 
to reach criterion. Multiple-comparison analysis revealed that 
infusions of the NMDAR antagonist AP5 induced a weak effect on 
performance during the set-shifting task, whereas AP5 infusion 
produced a pronounced impairment in reversal learning, leading 
to a significant increase in the number of trials and errors to 
reach criterion (both p < 0.05). Subsequent targeted analysis of 
the types of errors made during the set-shifting task after AP5 
infusion revealed a significant effect of Treatment (-F(i,io5) = 2.494, 
p < 0.05; Figure 2G). Infusions of AP5 into the NAc shell 
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FIGURE 2 I Effects of APS infused into ttie NAc core and NAc sfiell on 
beliavioral flexibility. The behavioral procedure included three phases: 
cue learning, set-shifting, and reversal learning. Set-shifting and reversal 
learning were tested 24 and 48 h, respectively, after cue learning. Each rat 
was infused with 0.5 |j.g (0.5 AP5 (dissolved In saline) per side before 
the test. The sample size in each group is shown In the corresponding 
column. (A) Number of trials and (B) number of errors to reach criterion In 
the set-shifting and reversal learning tasks following intra-NAc core 
infusions. (CD) Analysis of the types of errors during set-shifting (C) and 



reversal learning (D) In rats that received AP5 treatment in the NAc core. 
(E) Number of trials and (F) number of errors to reach criterion in the 
set-shifting and reversal learning tasks following Intra-NAc shell infusions. 
(G,H) Analysis of the types of errors during set-shifting (G) and reversal 
learning (H) in rats that received AP5 treatment in the NAc shell. * p < 
0.05, ** p < 0.01, *** p < 0.001. PE, perseverative error; RE, regressive 
error; NE, non-reinforced error. During the reversal learning task, 
regressive errors were further divided into "away" and "toward" the 
visual cue. 



increased the number of regressive errors {p < 0.05), without 
affecting perseverative or never-reinforced errors (p > 0.05). In 
the reversal learning task, the analysis of the types of errors also 
revealed a significant effect of Treatment (f (i,4o) = 5.662, p < 
0.05; Figure 2H), with a robust increase in the number of regres- 
sive errors {p < 0.001). Two subtypes of regressive errors were 
analyzed by two-way ANOVA. The results showed a significance 
increase in the number of regressive errors toward the visual cue 
(p < 0.05) and a trend toward an increase in the number of 
regressive errors away from the visual cue. 

To assess whether the blockade of NMDARs in the NAc 
affects the initial learning associated with visual-cue and spatial 
discrimination, we infused AP5 into the NAc core and shell, 
respectively, before initial training. The data were analyzed using 
separate f-tests for each kind of learning task based on each brain 
region. Figure 3 shows that AP5 infusion in the NAc core or 
shell did not alter simple learning performance, regardless of cue- 
associated or spatial discrimination (all f < 1.1, no significant 
differences). 

EFFECTS OF BLOCKING NMDARs IN THE DMStr AND DLStr ON 
SET-SHIFTING AND REVERSAL LEARNING 

The effects of infusions of saline and AP5 into the DMStr 
and DLStr on set-shifting and reversal learning are presented 



in Figure 4. The experimental procedures were the same as 
those used in the NAc treatment experiments. After initial train- 
ing, the set-shifting and reversal learning tasks were performed 
on the second and third days, respectively. AP5 was infused 
into the corresponding brain region before the behavioral tests. 
Rats that received infusions of the NMDAR antagonist AP5 in 
the DMStr required a comparable number of trials (f(i,83) = 
0.3002, p > 0.05; Figure 4A) and made a comparable number 
of errors (f (i,83) = 2.79 56, p > 0.05; Figure 4B) to reach cri- 
terion compared with controls. A nonsignificant trend toward 
an increase was observed with AP infusions during the rever- 
sal learning task, suggesting that the blockade of NMDARs in 
the DMStr mildly impaired intradimensional strategy-shifting 
ability without disrupting extradimentional strategy-switching. 
The analysis of the types of errors revealed no significant dif- 
ference between groups in set-shifting (f(i,66) = 0.0822, p > 
0.05; Figure 4C) or reversal learning (J'd.ee) = 0.1698, p > 0.05; 
Figure 4D). 

Similarly, no difference was found between the AP5-treated 
and control groups in the number of trials (F(i,86) = 0.6595, 
p > 0.05; Figure 4E) or errors (P(i,86) = 0.52 59, p > 0.05; 
Figure 4F) to reach criterion. The analysis of the error data 
indicated that NMDAR blockade induced a statistically sig- 
nificant Treatment x Error type interaction in set-shifting 
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FIGURE 3 I No effect of AP5 infused into the NAc core or shell on initial 
visual-cue learning (A, NAc core; B, NAc shell) or spatial discrimination 
(C, NAc core; D, NAc shell). In this experiment, only association learning 
tasks were conducted. The rats were required to learn an association 



between a visual cue and reinforcement or between a spatial response and 
reinforcement. Before the behavioral test, 0.5 m-9 (0-5 M-D of an AP5 solution 
or saline vehicle was infused into the NAc core or shell per side. The sample 
size in each group is shown in the corresponding column. 



(f(2,i56) = 0.0089,/) < 0.01; Figure 4G). Infusions of APS induced 
a pronounced increase in tlie number of perseverative errors 
{p < 0.05), without affecting regressive or never-reinforced errors. 

EFFECTS OF BLOCKING GluA2-LACKING AMPARs IN THE STRIATUM ON 
SET-SHIFTING AND REVERSAL LEARNING 

In this experimental session, NASPM was used to determine 
whether the blockade of GluA2-lacking AMPARs in different 
striatal subregions induces different strategy switching results. 
Twenty-four hours after initially learning the association between 
the visual cue and sucrose reinforcement, the set-shifting task was 
performed. The rats were required to learn a novel strategy to 
obtain the reward (i.e., by always nosepoking the left or right 
hole). The NASPM solution was infused into the NAc core, 
NAc shell, DMStr, or DLStr 5 min before testing in separate 
experiments. Twenty-four hours after the set-shifting task, half of 
the rats, which were infused with saline during the set-shifting 
task, were infused with NASPM solution before the reversal 
learning task. The other half of the rats were administered saline 
as a control. The results are presented in Figures 5, 6, showing 
the number of trials to reach criterion and the types of errors. 
Infusions of NASPM in any striatal subregion did not significantly 
affect the number of trials to reach criterion (NAc core: f (i,78) = 
0.2662, p > 0.05, Figure 5A; NAc shell: f (i,68) = 2.64, p > 0.05, 
Figure 5E; DMStr: f (i,85) = 0.0064, p > 0.05, Figure 6A; DLStr: 



^■(1.86) = 0.0005, p > 0.05, Figure 6E). Similarly, NASPM infusion 
in any of the striatal subregions did not induce any changes in the 
number of errors to reach criterion (all _F < 1.9, no significant 
differences). A subsequent analysis of the types of errors made 
during the set-shifting and reversal learning tasks revealed no 
difference between the NASPM- and saline-infused groups. These 
data indicate that Ca^+ -permeable AMPARs in the striatum do 
not play a crucial role in behavioral flexibility. The dose of 
NASPM used in the present study has been shown previously to 
affect reward-associated behavior (Carr et al., 2009). We may need 
to test doses of NASPM higher than 2.5 \ig in our future studies, 
but such doses may carry the risk of affecting the reward system. 

DISCUSSION 

The present study revealed that the blockade of NMDARs in 
the NAc core impaired set-shifting performance by increasing 
perseverative errors. The suppression of NMDAR-mediated 
neurotransmission in the NAc shell induced a deficit in set- 
shifting by enhancing regressive errors. These findings indicate 
that the activation of NMDARs in the NAc core alters prior 
learning or inhibits responses that are no longer appropriate, 
whereas NMDARs in the NAc shell play an important role in 
learning and maintaining novel strategies. Reversal learning 
reflects intradimensional strategy switching and was tested 24 
h after the set-shifting task. AP5 infusion in the NAc shell and 
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FIGURE 4 I Effects of AP5 infused into dorsomedial striatum and 
dorsolateral striatum on behavioral flexibility. The behavioral 
procedure included three phases: cue learning, set-shifting, and reversal 
learning. Set-shifting and reversal learning were tested 24 and 48 h, 
respectively, after cue learning. Each rat was infused with 0.5 \jLg (0.5 (il) 
AP5 (dissolved in saline) per side before the test. The sample size in each 
group is shown in the corresponding column. (A) Number of trials and (B) 
number of errors to reach criterion in the set-shifting and reversal learning 
tasks following intra-DMStr infusions. (CD) Analysis of the types of 



errors during set-shifting (C) and reversal learning (D) in rats that received 
AP5 treatment in the DMStr. (E) Number of trials and (F) number of errors 
to reach criterion in the set-shifting and reversal learning tasks following 
intra-DLStr infusions. (G,H) Analysis of the types of errors during 
set-shifting (G) and reversal learning (H) in rats that received AP5 
treatment in the DLStr. * p < 0.05. PE, perseverative error; RE, regressive 
error; NE, non-reinforced error. During the reversal learning task, 
regressive errors were further divided into "away" and "toward" the 
visual cue. 



core significantly increased the total number of trials to reach 
criterion and the number of regressive errors, indicating that 
AP5-treated rats exhibited dysfunction in novel strategy learning 
or maintenance. In contrast, no significant alteration was induced 
by APS infusion into the DMStr or DLStr in the set-shifting or 
reversal learning task. We also tested the selective GluA2 -lacking 
AMPAR antagonist NASPM to assess the effects of blocking 
GluA2 -lacking AMPARs in different striatal sub regions on 
behavioral flexibility. No effect was found during the set- shifting 
or reversal learning task. 

Schizophrenia patients exhibit impaired cognitive flexibility 
measured by the Wisconsin Card Sorting Test (WCST; Everett 
et al., 2001). In the extradimensional shift stage, both schizophre- 
nia patients and frontal-lesioned subjects exhibit pronounced 
deficits, whereas only schizophrenia patients make significantly 
more errors in the intradimensional reversal stage (Pantelis et al., 
1999). This suggests that other brain regions, in addition to the 
frontal cortex, are abnormal in schizophrenia patients. The stria- 
tum may be an important target among these regions. Subjects 
with schizophrenia exhibit striatal dysfunction during reward- 
related reversal learning (Schlagenhauf et al, 2014), and the 
striatum receives excitatory projections from the frontal cortex 
(Reynolds and Zahm, 2005; Xu and Sudhof, 2013). 



By microinjecting y-aminobutyric acid receptor agonists to 
inactivate the NAc, Floresco et al. (2006) demonstrated dissocia- 
ble contributions made by neurons in the NAc core and shell to 
behavioral flexibility during the set shifting task. These authors 
found that set-shifting was impaired after inactivation of the NAc 
core but not shell, attributable to disruption of the acquisition 
and maintenance of a new strategy. However, we only blocked 
NMDAR-mediated transmission, which may be a major reason 
for the discrepant results between the study by Floresco et al. and 
the present study. In addition to receptor targets, the discrepancies 
between these two studies may be attributable to differences in 
the training protocols. An automated procedure was used in the 
present study, which decreases the likelihood of experimental 
bias and increases consistency in timing and stimulus intensity 
compared with the cross-maze setup that was utilized by Floresco 
et al. The NAc core receives projections from the prelimbic cortex 
(PL), whereas the NAc shell receives projections from the infral- 
imbic cortex (IL; Voorn et al., 2004). Lesions of the PL impaired 
set-shifting performance by inducing deficits in inhibiting the rel- 
evant learned strategy. The IL may support behavioral flexibility 
by maintaining the reliable execution of a new choice pattern 
(Birrell and Brown, 2000; Ragozzino, 2007). In contrast to the 
differential roles of NMDAR activation between NAc subregions 
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FIGURE 5 I Effects of NASPM Infused into the NAc core and NAc shell 
on behavioral flexibility. The behavioral procedure included three phases: 
cue learning, set-shifting, and reversal learning. Set-shifting and reversal 
learning were tested 24 and 48 h, respectively, after cue learning. Each rat 
was infused with 1.25 |j.g (0.25 |il) NASPM (dissolved in saline) per side 
before the test. The sample size in each group is shown in the 
corresponding column. (A) Number of trials and (B) number of errors to 
reach criterion in the set-shifting and reversal learning tasks following 
intra-NAc core infusions. (CD) Analysis of the types of errors during 



set-shifting (C) and reversal learning (D) in rats that received NASPM 
treatment in the NAc core. (E) Number of trials and (F) number of errors to 
reach criterion in the set-shifting and reversal learning tasks following 
intra-NAc shell infusions. (G,H) Analysis of the types of errors during 
set-shifting (G) and reversal learning (H) in rats that received NASPM 
treatment in the NAc shell. No changes were found in the set-shifting or 
reversal learning phase. PE, perseverative error; RE, regressive error; NE, 
non-reinforced error. During the reversal learning task, regressive errors 
were further divided into "away" and "toward" the visual cue. 



in extradimensional strategy shifting, NMDARs in both the NAc 
shell and core make the same contribution to intradimensional 
strategy switching. The activation of NMDARs in the NAc may 
facilitate the learning and maintenance of new strategies. In the 
present study, the rats that underwent reversal learning testing 
were previously subjected to the set-shifting task. However, the 
impaired ability in spatial reversal induced by NMDAR block- 
ade did not result from alterations in set-shifting because no 
interaction was found between "away" and "toward" visual-cue 
regressive errors. An impaired ability in reversal learning has been 
previously reported in studies in which the ventral striatum and 
dorsal striatum were subjected to excito toxic lesions (Ferry et al., 
2000). Similar deficits are also found with lesions and inactivation 
of the OFC (Chudasama and Robbins, 2003; Boulougouris et al., 
2007; Ghods-Sharifi et al., 2008). An interaction has been sug- 
gested to exist between striatum and OFC functions in reversal 
learning (Frank and Claus, 2006). However, the modulation of 
reversal learning ability by the OFC depends on task difficulty. 
When the reversal task was performed between two strategies, 
inactivation or lesions of the OFC produced perseveration (Bohn 
et al., 2003; Chudasama and Robbins, 2003; Boulougouris et al., 
2007). In contrast, OFC inactivation increased both perseverative 
and regressive errors when four-choice odor discrimination was 



required (Ragozzino, 2007). In the present study, reversal learning 
based on an operant task may be more difficult than two-choice 
patterns. Thus, the blockade of NMDARs in the NAc increased 
regressive errors in the present study. Although an impaired 
ability in working memory has been demonstrated in some cases 
of cognitive inflexibility (Blot et al., 2013; Darvas et al., 2014), 
working memory performance in the present study did not appear 
to be altered by blocking NMDARs in the NAc. No significant 
changes were found in the cue-learning task or spatial response 
when APS was microinjected into the NAc shell or core. 

The dorsal striatum contributes less to flexible behaviors 
compared with the ventral striatum, although impaired reversal 
learning performance suggests that NMDAR-mediated glutamate 
transmission in the DMStr plays a role in behavioral flexibility by 
at least partially supporting a shift in intradimensional strategies. 
Similar results have been reported in previous studies that used 
a reversal learning task (Palencia and Ragozzino, 2004, 2005). 
However, inconsistent results were found in the set-shifting task 
with DMStr treatment between the present study and previ- 
ous reports. We did not observe any apparent change in the 
set-shifting task when NMDAR activation was blocked in the 
DMStr. Ragozzino et al. inactivated the DMStr based on a cross- 
maze experimental design and found that this region mediates 
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FIGURE 6 I Effects of NASPM infused into the dorsomedial striatum 
and dorsolateral striatum on behavioral flexibility. The behavioral 
procedure included three phases: cue learning, set-shifting, and reversal 
learning. Set-shifting and reversal learning were tested 24 and 48 h, 
respectively, after cue learning. Each rat was infused with 1.25 \ig (0.25 
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each group is shown in the corresponding column. (A) Number of trials and 
(B) number of errors to reach criterion in the set-shifting and reversal 
learning tasks following intra-DMStr infusions. (CD) Analysis of the types of 



70- 

c 60' 
o 

I 

g 40- 
S 30. 
o 20' 
10- 







Set-shifting Reversal learning 






G 




H 




70- 


Set-shifting 


70- 




60- 




60- 


Q. 


50- 




g; 50- 




40- 




% *»■ 


tf> 


30- 




2 30- 


o 
m 


20- 
10- 




10- 
0- 



I- 



Set-shifting Reversal learning 



Reversal learning 




errors during set-shifting (C) and reversal learning (D) in rats that received 
NASPM treatment in the DMStr. (E) Number of trials and (F) number of 
errors to reach criterion in the set-shifting and reversal learning tasks 
following intra-DLStr infusions. (G,H) Analysis of the types of errors during 
set-shifting (G) and reversal learning (H) in rats that received NASPM 
treatment in the DLStr. No changes were found in the set-shifting or reversal 
learning phases. PE, perseverative error; RE, regressive error; NE, 
non-reinforced error. During the reversal learning task, regressive errors 
were further divided into "away" and "toward" the visual cue. 



the maintenance of novel strategies after perseveration ceases 
(Ragozzino et al., 2002). In the DLStr, the increase in the number 
of perseverative errors in the set-shifting task may be attributable 
to the modulatory role of this region in stimulus-response habits 
(Jog et al., 1999). 

NMDAR-dependent long-term depression (LTD) and synaptic 
changes can be modulated by endocytosis of GluA2-containing 
AMPARs (Lim et al, 2012), suggesting that GluA2-lacking 
AMPARs may replace GluA2-containing AMPARs during learn- 
ing. However, no deficit was observed after NASPM treatment, 
indicating that the activation of GluA2 -lacking AMPARs is not 
a downstream event of NMDAR-induced transmission involved 
in flexible behaviors. AMPAR antagonism with LY293558 in the 
mPFC induced general cognitive deficits (Stefani et al, 2003), and 
infusions of the AMPAR antagonist DNQX into the ventral stria- 
tum impaired spatial information processing in a nonassociative 
task (Roullet et al, 2001). These previous studies suggest that 
AMPARs may be involved in simple learning and general cogni- 
tion rather than specifically cognitive execution. Under physiolog- 
ical conditions, most AMPARs in the striatum are either GluAl/2 
or GluA2/3, whereas <10% are homomeric GluAl or GluAl/3 
(Boudreau et al., 2007). Furthermore, although the endocytosis 
of GluA2-containing AMPARs is a mechanism associated with 



synaptic long-term plasticity during learning (Liu and Zukin, 
2007), other forms of plasticity may also be involved in this asso- 
ciative task, such as mGluR-dependent patterns (Anviyl, 2009). 

In summary, pharmacological tools associated with gluta- 
mate transmission may provide a potential clinical treatment for 
schizophrenia. In addition to the frontal cortex, the ventral stria- 
tum may be another important brain region for adjusting behav- 
ioral flexibility. These findings suggest that NMDAR-mediated 
glutamate transmission in the ventral striatum makes more of a 
contribution to cognitive execution than the dorsal striatum. 
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